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CHAPTER I: INTpDUCTieN '. ' . 

In this chapter the purposes of the evaduation are'state^, followed 
by a' description of the Technical Aaaiatance Unit (TAU) and its objectives. 
Finally, the chapter lists the at43iences for the evaluation and a summary 
of the format of the report, 

Purppses of thg Evaluation % 

This evaluation was int;ended to serve three main purposes fe>r' the' 
- Teohnioal Assistance Unit (TAU)y the Improving Teaching Competencies 
Program (ITCPl^and the Northwest Regional- Educational laboratory ' (NI7REL) . 
First, it was a study to determine the feasibility of establishing the 
\TAU.^ As such, it^prodilced information that can be used to cletermine 
' whether , and how the TAU should continue \its- work beyond fiscal yelar 19^6 
in'the ITCPis contract with the National Institute of Education (NIE) . 
Second, it was int|nded to improve the TAU^s functioning during* fiscal 
year 1976. As such, information produced during this evaluation was 
reported continuously to the TAU, ITCP and NWREL. ^Third, it was intended 
to be a useful first stage of evaluation upon 'which subsequent evalu- 
atioij could be built, A^ such, it tested, pro.cedures through. which the 
feasUbility and functionirfg of the TAU cbuXci ^ monitored in the futurev 

Description of the Technical Assistance Unit 

At the time this, study was cond^ucted, the TAU was one of si3^ work 
components, in the;Field Relations and Dissemination Work Unit (FRDWU) 
^ of the Improving Teaching Competencies Prograjn.,''" The ERl5wu also had the 

T-^'' ■ * . 

^See the Resource AllocatidH and Management Plan of the Ii^rovihg .Teaching 

Competencies Program, 'J.975, for details. ' . 
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following work components to complete; ^1)^ ^evdlo^ing a conceptual 

model I. to guidfe dissemination and diffusion of IT€P \instructional systems ' 
* ^ \ ' .\ ' * ■ 

and. other programs or products with similar aims. arid tormat#i (2) develop- 
ing, implementing and evaluating a^stlrate^gy for dissem^^nating selected ^ 
ITCP instruct^ional systems' in Individually Guided Education. <IGE) schools ' * 
in collaboration with the Wisconsin Research and DevelbpAent Cfenter, 
(3) developing, implementing and evaluating a strategy fot 3lsseminating 
ITCP instruction^ systems in the Florida-Teacher Center Nfetwork, 
^4) planning, implementing, and evaluating regfonal workshopW us^^ng 
selected ITCP instructional systems and (5) serving in a fi^d relations 
capacity to set up field test sites for the Social Conflict 
Mgptiative Problem ^Solving instructional system af the ITCP.'\ In 
addition, TAU members participated in the Inter-Lab Consortium\ that 
is expl6ririg ways to increase utilization of the products of several 
research and development efforts. 

Given that the' same personnel performed tasks in these fiye 
components and the^ Consort^ium as well' as in the TAl)^ some evaluation 
activities wer6 aimed at answering questions to describe the TAU as a 
separate entity. A careful and precise delineation of critical activi- 
ties by these personnel was necessary to determine the XAU^e feasibility, 

improve its functioning and provide test procedures for future ^ ^ . 

. ' ^ ^ i 

monitoring. ' ^ 



Object ij^s ^f the Teekniaal Aaaiatimoe Unit \ 

This section describes the TAU'a objectives for fiscal year. 1976 
^nd relates these objectives to the purposes of this evaluation. The 



* • 



See.Arends-, Richard I. , Strategies for Disaeminating and Diffusing .the 
Ideaa^ PraotioeSy and Products of the Improving Teaching Competencies 
Program y June 1976) ^ ' y 
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iZVli/ establishe*nhe following ol)jectives: 

•r ' 

. 1. To provide technical assistance for any interested * 

users of ITCP instructional systems • ' \ 

2. To eM^re and facilitate the use of ITCE instruetional" 
systOTS on a shared-cost or a total cost contractual 
.basis . * ^ ' ' 

' ' 3. To solicit and ddntract with n^ clients 

4. To develop ^and implement multiple strategies for 
disseij^nating in<y[vi<iual >ITCP systems and ' clusters' ^ . • 

^ ' of ITCP systems such as Providing Organizational * 

Developments. Skills (PODS) - *^ - 

5. To document, study and analyze strategies used ^ . , . 

6. To determine the extent to which the TAU zan become--,!^-' ^ 
$elf-sulpporting ^ 

7. T9 maintain a continuous relationship 'with t;he field ^ 
to facilitate any fu^re needs for field-based^ 
I^esearch, D§velopm*ent^ Dissemination ^nd ifevaluation > 
(IU)D&E) efforts - 

8v • To reach a shaVed undetstanding of how* this unit will 
interface with other Lab administrative ,un^s, e,g., 
; I Office ^f Diss^ination and Marketing, Educational 

Services Division, etc. (see Appendix A for complejte 
^ * statement of scope of work). « . ' * 

Objective^^ was to be accomplished by collecting information 

serve all three evaluation purposes . Objective 6 was to 'be accomplished 

through' collecting information to determine the feasihillty of the TAU 
\ ' ' ..... 

4pd objeQtive 8 waa to be accomplished in part by collecting information 
intended to improve the TAU's funct^^ing. 



IXCP instructional systems included itt' the PODS cluster include: 
Interpersonal Cormuniaationa " ' , . ' 

Research Milizipg Problem Sowing 
; . Interpersonal InfLuenoe , ^ 

^Preparing Educational Training Consultants:^ Skills Training (PETC-I) 
and'^Group Process Skills (GPS) ' 
Freparir^ Educational Training , Consultants : ' Consulting (FETC-II) 
Preparing Educational Training Consultants: 'Organizational Develovmenit 
(PETC-III) ^ \ ^ . 

Social Conflict and Negotiative Pi^lem Solving 
♦ Other ITCP instructional systans tJhe disseminated include: 

Systematic and Objective; Analysis of Instruction - / 

Develc^ment of Higher Level Thinking Abilities 
\ , Facilitating Inqiiiry^ in the Clofisroom , ' ' 

ERIC ', {{) ■ \ , ^ 



Objectives 1, 2, 3, 4. and. 7 we,re of a different character. Rather 
^tfcan achieving thesg obje<itWes, the evaluation was ^ to determine 
whether and ho^, they were accomplished, -Whether they were accomplished 
was -to 'determine the feasibility of t^e TAU ^ How they yere accomplished 
was to determine wHat needed to be done to improve the TAU'a ' 
functioning and to^mpnitor the TAU's functioning *and feasibility '^n 
the future. - , i - 

Audiences for- the Evaluation . * . * \ 

Several audiences Were considered dn the^reparation of ibis ' 
report.- They included; the TAU itself, ^to provide Iriformalion which 

will assist in improving its functioning; the ITCP, the TAl/ and NWREL, 

«' * ^ 

to«-assist in making decisions about wheJther arid how thB TAU ?l#uld 

•continue its \iork beyond fiscal, ylar 1976j NIE, to provide information 
a^out the cqnditions under which technical assisters can exist and the. 
part NIE may taVe in'supporting tjifem; and any others who may be inter- 
ested in the establishment of technical assis^ta(|Ae unit% or in becoming' 
technical as3isters. x * ' . / 

^ Report Format * » . 

*^ ^ * • 

• • * * . r ' 

The report contains four chapters and a section o'f appendices,. 

»- t * . « ^• 

Chapter I introduces the Veport. Chapter II describes the evaluation 
design. Chapter III report's the result^ of . the* evaluatiwi. Chapter IV 
\±3 Oi sum^iary and discussion ofv the findings. . , ' 



/. ' EVALUATION DESIGN 

^ Chapter I? ifiol^J^,;*'^^^ the evaluation' cont^ti a list- 

of the ev;dluation questions- and a \tescription of the overall evaluation 

^ • ' / * " ' , ' • ' t 

. methods. h ^ * • 

The evaluation 'study was plann^ and conducted during FY 76, " 

specifically between March fend October^ 1976. As ail evaluation of the'' 

work of a particular: sul^-unit of a particular work unit. in th^ IKP^"' 

I. if was avfirst.. Unti; FY 76, all evaluatW studies^ of the ITCP/had' 

been- directed towa^rd evali^tring the efficacy of instructional systems. * 

In KY 76. the ITCP began t»look at it^ capabilities to diffuse and" * 

*^ 

di«seminat-e -these -instructional systems.' ^ ' , ^ 

Part of the effort at examining these capabilities entailed the ^ 
development of a conceptual scheme th^t is* summarized in* Table 1. The 
conceptual document by R. Are^ds (June 1976) described how the- JVli/' would 
likely empkatize strategies .fj 2 and 3 while other efforts of the FRDWU 
would begin to tfest strategies 4 and 5 in FY 76. >Implem'entation and * 
evaluation of stratgies knd 7 aitd* the coft^uct of the efficacy of the 
different strategies could happei\ only if future funding was obtained. 

To assess the XTCP*s dissemination Ciapabilities necessitated 
providing four kinds of ev^luati<^ informatipn for and about the TkU.^' * 
Thfe first kpd was diagnostic or contextual ; TAU members ^m^ted to find, 
out about the kinds of situations whic^ they would be' involved. They 
wanted to ascertain condition^ the^ would meet as they beg*i each new 
'activity. For example, before mailing out detailed inforn^tion on a 
particular. Instructional system to a particular population'^of pepple**, 
they wanted to knpwif t he ^ intended recj^ients .had already received ' 
more gener^, first.- level oat;eri&l. ' — '^^^ 



Table 1 , *^ 

\. A Suinmary of Categories and^ 
^Dissemination and- .Diffusion. Strategies 



\ DISSEMINATION 



DIFFUSION 



TECHNICAL 
ASSISTANCE 



TAILORED 
COSSI5.IATION 



"1.- . Market intact instructional 
s'yst^ems to individuals ' 



2. Market wqryigMMpriences ^ 
using int^^lP^P^nttional 

. systems to individuals 



.3* ProviTie training of trainees 
• and technical assistance 

usiilg ^some intact instructional) 
sysi^eriis to "institutiorvs and • * 
agencies wisl^ing to adajrt and . 
Ms.e componepts of ITCP 
Curriculum - . 

4. Provide training of trainers and 
technical assistance using all 
or clusters of iijstructional 
systems to institutions and*^ 

' agencies wishing to adopt and 
'use the ITCP. curriculum 
^ ^ - - --f 

5. Providi taiiSred' ttaining, 
^ consultation and^ product ♦ ^ 

^ support to instituWQns'^nd 

agencies iiSvolved in a. change i 
effort ^itoed at* impravemeht of 
school practices or aim^ at 
improved otganizational 
functioAing 



/ 



.Provr4e. tailored ^trainlning, ^ " 
consultatibn and produjji^dup^^t 
to organizations for itistitution- 
alizing permanent ch^inge ^capacity 
sucR as Internal consult^ints, 
cadres of OD fpe<;lali8tq, or 
those who hold roles as linkers 

Provide network coordination and 
tailorcci consultation tO internal 
consultants, members of internal 
cadres, and linkers ^ 
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A second kind of evaluation,* coocern,ing qudgments of activities 
that might be tried, was 'called input* evaluation. Moire than one activity 

^;wa:§,:alwarys feasible in technical assistance work,. and- TAU rafembers always 
made choices. . They considered various^' plans ^d compared their probable 

.effe^:ts with'estalplished goals and' objectives. For example, before 
deciding. Co" have a face-to-face meeting with an individual who might 
be able. to locate a client groUp ^or technical assistance,, the TAU had 
to decide if a^ letter or a ^l^one call might not .produce the desired 
resultr^ , . ; , ' ' / 

A third \kind. of fevaiwation, called process evaluation, examined 
• / 

the short-term effects 'of activities,. What proportion of t'Ko'se 
receiving the mait-out' brochure requested more information abo'ut itCP t/ 
instructional systems?^ Wa? th^ptoportion greater or^ smaller when the 
tprochure* was handed out in^^n^nction with an oral presentation at a 
^meeting? Wer6 sujjerintendents' more likely tharh sCaf f-^evelopment 
direc-tor.s to call the TAU on their own initiative? Answers to -questions 
like these told TAU members whether the processes they set in^ motion 
were having the desired- effects In the short term.. 

^ A fourth sort of evaluation, product or outcome * evaluation, told 

whether activities pro'duced results overall that Jtist'if ied the time 

' ^ 0 f 

and expense. TAU' members wanted outcome evaluation information to use 

in convincing others of the* manner in whi6h the JVIJ/' should be continued 

beyond' fiscal year 1976. When they tailored tfJe^^CP's validated, 

instructional systems to ''better meet the needs of u.sers, they wanted 

^ ^ ' • ^ f 
information to begin validating -the impact .of the* tailored systetjis. 

There are two. main reasons why the^ evaluation concentrated on 

providing contjytual,* input and prpcess evaluation, information mor/ 

than^ outcome evaluation informatfon. * First, •the amount^ of time* 

7 



* . I.' ' * ^ 

available for this evaluation was insufficient to study the long-term 
^effects of^TAu actions; decisit>ns 'about continuing the IMi/ had .to be 
made on information about its operation and short-term effects, ' Second, 
the ITCP already'had evaluation inf,prmation on theJ?!!nstructional systfems 
that haji be^n collected while they werei validated and 1iad little need 
for more at this time. For these reasons, the evaluation built the . 
!4ata base to which compariso'ns/can be made in the future. 

Th/ evaluation did include 'an indi^rect means for providing outcome 
evaluation inf pnjiiation since TAU members wete ajsked to* reflect' upon t]}e- 
helpfulness of diagnostic, input and process evaluation activities sfnd 
shaped these so they perhaps may have outcome evaluation usefulness in 
the futui^e. • ^ , „ ^- 

gvaluati6n Ques^^ions 

swered by the evaluat/on 

activities described in this report. Questions related, to the TAU's 

feasibility are presented first and/are followed by questions related 

to the TAU'8 functibning and the evaluation. 

Questions related to the feasibility of the TAU'. 

1* To what ^extent does the TAU pi;pvide technical assistance 
to any Interested users of ITCP instructional systems i?f 
and become self-supporting in ^oing so? 

2. Tq what extent does the TAU ensure and facilitate the 
us6 of ITCP instructional systems on a shared-cost qr 
a total cost Contractual 'baeis and become self-supporting 
% in doing sp? ^ 



Five ^questions were asked to parallel the five relevant objectives n 
(objectives 1, 2,.-.3, 4 and 7) of the TAU\ The basic question was 
implicit in the sixth objective,' to what extent does the TAU become- 
self-supporting in-fiscal year 1976? 



3. To, what extent does Ihe Ti4V>olicit and contract wltW' 
Sew clients and become, :$eilf-supj)ort±ng, in^ doing so? 
' ^ f it ' 

. 4. Td .what extent Maes the TkU develop and implement 
multiple strategies for* disseminating individual 
ITCP^ systems ^and 'clusters of systems such §is POD) 
ahd 'becoijie self-supporting fn doing so? * •/ 

5. To wha\ extent does XSji^ TkV maintain a continybus 

f. relationship with the field to faciH^tate an/ future 
-ne^ds for field-based RDD&E efforts aridt b,eo^e (self- 
supporting in doing 'so^ • ' 7 A 

Questtons'^elated ■ to Ti4i/: functioning: ^, 

, * * - r • ' " / ^ 

*i % * * • j' ^ ' * 

6. ^at is thf: position;, 6f the TAU ±n Its institutional, 
environments Wtiat exponents of ^. the FKDWU,' ITCP^ 
NWREL, NIE arftT pfxblishers are involved ;in TAU 
activities :ks goal-setters, funders, technical 

.assist ers^or /consultants, decision makers, etc. J 

T . * - ' * 

7:- What is t*ie nature of TAU's institutional environment? 
Firom'Vhich components does the TAU^ draw resources oi ' 
various kinds? What . are the. Ltaes of accountability 

^, and influence between the TAO/and other components?* « 
What are the histories and p&ssible future of inter- 
faces of the components and/the TAUl ' 

8. *Wl}at is the .absolute *find Relative size of the TAU 

within th'& ERDWU in., term^ of PTE, budget, 'pef-sonnel 
. qualifications? 
. '* • ^ ' / 

9. To whic!!^iece3 of ^q/tk within the TAU are personnel 
. and ofher resourcesyfilloc^ted? What Relative ^d- ' - 

absolut;e trolumes ofr resourc§!^^re expended on various- 
pieces of work? 

10. What are the methods of interacting *with potj^fttial' 
clients'? (e.g/ phone calls, printed material, oraP 
prese^ptations/ demonstration events, etc.') With 
what frequency and in what secjuences various 
methla^s us€ " 



,Ait examinati^ of TAU functioning Was iAtended to enAbl.e the^ITCP and 
.NWREL.to b^ln. explaining wtr^ the TAU wis feasible, tp. the extent it 
•pro^^ed, tt be and to enable the TAU to improv,e.,its fynctionihg during V 
•FY 1976. Such^ examination ^required: (a) an anlysis of the TAU, - 
'(b) an analysis df the TAU's clients (potential and actual) and (c) "an 
' analysis of interactions between the TAU and clients. An indepth 
examination of all possibW variable? in these three categories wpuld 
,have taken more time an4 staff . than. was available,' so the questions 
here must be,con^i^ered as only a preliminary or "starter" set whixK'. 
should be added to'and refined 'in future evaluations. 
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II,. To vhat degree and In What ways^Are the methods .tailored 
or adapted to specif lc\potentlal clients? To what degre 
.do the laethods make use of new or invented channels .and 
' two-way communication as opposed to famll^-^r or existing 
channels and one-w§y conpiunication? 

12. What costs are Incurred by the TAU in using various 
methods? What are the relative and absolute jjolumes of 
resources expended by the TAU for these methods? 

: — _ . . , ' / A ■ . 

13. What methods and sequences of methods *Vork best/* i*e«« 
are most often associated with potential clients who 

. become actual' clients of the TAUl ' ^ 

14. What are the demographic features (age, position; race/ 
ethnicity, location, academic -background, experience 'in . 
-education,*, pr^ious experience with NWREL, ITCP or 
instructional systeips, , etc. ) of potentiiil individual 
clients feKat most often ar^ associarted with becoming 
actual individu*^ clients? ' * 

♦ ^ / 

15. \ What are the demographic features of decision makers 

most oftgn associated with committing others or the 
^ agency to be an actual client? 

1^ What are the demographic features of agentles^Csize,"^ 
location, ^ locus of decision making, type "of agency 
and previous relationship with NWREL, ITCP or • ^ 
instruct^nal systems, etc.) most often associated 
with becoming, actual agency^ clients? 

17. According to tlie' reports of actual clients, through 
what methods did they become aware of the TAU and' 
decide to make use of its products and services? ' 

» 

18. According to the reports of actual clients, in what 
ways dofihey intend ^o make use of the instruptlonaj. 

* systms and the TAU in the future? ' ^ / , 

Questions related to evaluation procedures: ^ 

19. To what extent are evaluation procedures specified - 
in this design carried out as planned? ^ 

20. What factors account for deviations from these 
procedures, if ^any? * * 

21^ 4fliat do the TAU, ITCP and NWREL wish to recommend , 
in t^rms of future procedures for. monitoring the 
feasibility and functioning of the TAUl * ' 



Overall Evaluation Methods ^ . • ,* 

; Because of the varielyof informatioti to.be coliected, a dumber of 
methods were devised. Methods were selected to the following triteria: 
(1) high likelihood of producing the necessary fnf otjnation, (i) more 
thaii one way to gather inost kinds of information in case one or more 
methods prove to be unworkable^an'id (3) requiring only som6 ^additional ' 
effort on- the part of present TAl) staf f "iftembers and only some new staff. 

The methods employed were also intended to build the self -analytic 
capability of the TAU in line with 'its objectives " to f document, study' 
and .^nalyze strategies used.'^ For this reason, methods that were 
totally dependent upon the presence of outside evaliiitor^" were rejected 
in favor -of methods in which TAO memhers could participate. . 

4 

Acti-\^lty Report. Fijrms 
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*i,TAll m^embers were asked to log any activity that met one or more of 
the following criteria: (1) i^ occutted on the 7th,' 17th or 27th day 
of 'any month after June 1, 1976, (2) it had a 'direct relationship to 
the TAU but had little to do with other work components of the FRDWU ot 
(3)/ it di^d not directly concern TAU act^^ivitips, but in the minds c^f TAU 
members it was extremely important ^and might have had some indirect ' 
relationship to their abilities to TAV work. A standardized form ' 
was provided (Appendix C) and NCR duplicator rpaper made it* possible ^ 
for -the author, th^ TAU file ^n<} evaluation srtaff to have copies. (See 
^pendix B for ^ copy of this form). 

Contact Record Fortes 

!Zi4i/' members kept^a written record of aU potential and actual 
clients who were sent any kind of dissemination in;formatiop, who 
participated in anV ?RDWU- sponsored activity, or who initiated action 



vis-d-vls the FRDWU. A standardized £orp w>s provided (see Append.ix C) 
for recording data that became available^after June 1, 1976. Importantl^, 
the TAU already had .a tremendous backlog of relevant data in the forms 
ofj (1) a record of all incoming telephone calls that da^ed back several 
months, (2) lists of peVsons arid institutions whp had purchased instruc- 
tional sy^tem^, (3) lists 'of persons to whgm NWREL had previously sen^ 

~ information s^bout the ITCP and its instructional. 'systems and (4) a 
correspondepoe file t^t included *ncom4:ng letters aijd copies^ of. outgoing 
letters and tliat dated back ^several years. Back-logged data were trans- 
ferred to Contact Re*cord Forms only if the person 'was .ihvdlved, aft^r 

^June 1, 1976. . \ ' • . 

iFo'rmal -Documents andlRecordg . ^ . ,^ 

^ Much of the information to Be collected already existed, in formal 

documents and record? of the ;ri4i/,. Th6 FRDWU^ the ITCP and iJWREL. Example^ 

of these sources included monthly c:ofii^>uter printouts of the ITCP' s 

/budget;* proposals, -scope-of-work statement's and contracts sent to NIE; ^ 

evaluation repctftis by the ITCP; the ins true ^tional system's and dissemination 

literature^ ^r^i/ members agr,^d'.to ,f acilitatfe the search by earmarking * 

relevant parts document's and records for the evaluation staff upon * 

' request. ^ , ■ • i ■ ■ ' 

\ • ■ •> 

Informal Interviews ' ^ 

r — 1. ^ . . 

ITCP evaluation staff had many^opportiitiities to interview TAll^. ; 
staff infonually^. Evaluat^Lon staff kept records of 'the questions they 
asked and answers they heard. Examples of topics for iitterviews^ included: ' 
the contents. of a particular formal document or record, additional data ' 
, f rom some Activity Report \ or ^Con,t act Record Form and the satisfa^ction ^ 
of TAU members with eyaluatian activitied> * - * 



.Review Panel • * ' • 
■ ■ . . ^ , 

^ S<i^e of the information tq be collected/ coocerned judgments of the 
activities of the- TAU, A foujr -member panel met /oy^one day in November, 
and'^ave iTVli/ , members feedback on their progress and plans, - Evaluation 
staff convened this session and . collaborated with !1%U meitfbers and both- 
ITCP»and NWREL decision makers in determining whose -ppinions and'what * 
specific judgments ahd feedback to seek, (See Appendix D for a report 
pf the Review Panel), 

Postsession Reactions . . 

• ..^ ' . • ^ . / . • 

gome pf the information to be collected "^aonterned -tHe judgments, 

. i-mpressions or reports of actual clients about the ways in which they^ 

became invalved and used or planned to use the services and products -of 

the TAU, All clients who attended .a workshop done by the TAU 'unit Were 

asked to complete a' Postsession Questionnaire or otherwise .report their 

reactions. No standardised instrumentation was developed for this * 

purpose, but a summary 'of reports from clients appear in the findfngs 

reported in Questions 17 «and 18* , « ' " • • 

Interim Data Analysis Sessions ^ \ 

TAU members and the evaluation staff met periodically tb examine 
data collected through other methods. Evaluation staff convened these 
sessions to report what A<;tivity Report Forms' to date showed about the 
activities of the TAUy such as how evaluation procedures w^re being 
implemented. In addition, these sessions were used to schedule or plan 
other evaluation activities such as the -Review Panel Meeting. Minufes 
of these meetings were kept by the evaluation Istaff ^and exQerpts are 
j^iihd in Appendix E, , K • ' 
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Data- collection procedures were monitored to Insure that they" 
.protected the anonymity and privacy of subjects. Contact. Record Forms - 
included the names .of actual people with vhom 'the TAU members interacted,' 
but these forms will not be' made available^ to pJersons other than TAU 
member^ and evaluation staff and n ames or data that could be used->t6 
Identify a pa;rticular potential or actual client of the TAU have been • ** 
eliminated from thfe final report. . ^ • . * . 
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CHAPTER StII: RESULTS OF THE EVALUATION'' 

/ As previously stated, this evaluation collected information to 
make judgments about the feasibility of establishing the' TAU, and to 
^ serve as a first s'^age upon which additional evaluations could be built. 
' Tlie piajor sourc^ of information was, th^- TAU it^elf, the kinds Of activi- 
ties it^ngafged im an.d its result^ in terms of 'contracts signed and ^ 
prospects for additional contracts. 

TJiis section is divided into three parts, corre^onding to- the 

' * I ^ ^ 

organization of the evaluation questions. These categories include:, 

* * 

C b) quest J,ons related to the feasibility of the -IVli/; b) questions relat€;d 
to TAV functioning; and c) questions related to evaluatifan procedures. 

^ Questions Related to* the Feasibility of the TAU 

Information for questJLons 1 -through 5* wa)S secured from members of 

the TAV, ITCP and NWREL decision makers, and the Review Panel, The 

mej^hods used were informal interviews and the tape and ;report of the' 

/ * ' \ . , 

Review Panel's discussion (Appendix D)^ ' 

1.. . To what extent^i^es the TAU provide technical ' ' ^ 
assigjtAnceyto any interested users of ITCP 
instructional systems and become self-supporting * ^> ' 
in doing so ? 

All of the^ contracts signed by th^p^ during -the period upder 4 

• study were>to deliver one of the ITCP instructional systems (see 

Appendix H) . * Mo?t of t]je rest of the Activity Record^ entries indfcate 

an interest in one or mote of the ITCP products. This information 

suggests thaft the TAU"" ^oes provide technical assistance to .interested " 

, persons and agencies. 

Wtie^ther the 744/ be^orafes self -supporting in doing so is npt so clear. 

The Review Panel f'dtind this question *so , significant and so perplexing 

♦ 

that a large amount of its 'time was spent on issues surrounding ^ . 
O . ^ ' ' of> 15 
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^conditions which must exist and kfinds of data which must be collected* in 
ordefr to, know what is required for the TAU tcf become self-supporting, 
A discussion of these issues is Included in Chapter XV of this report. 

2. To what extent doe^ .the TAU ensure and facilitate . 
the use of ITCP instructional systegji^s on ,^ shared- y 

^ cost or tot^l cost cont;,ractual basis and become 

j^^ self-supporting in doing so ? i 

In each of the contracts signed during the period of study the cost 
of delivery of the "instructional systems was wrl/tten into the contract. 
These costs included trainer feea, travel and per diem foi;, the trainers^ 
workshop materials, transportation of things and Indirect costs. In each 
case, the client assumed all costs of the contract. Expenses incurred 
>in negot^ting were paid by the ^TAU, 

Information available does not include data about other costs prior ^ 
to the delivery of the workshofJ', such as staff time to negotiate and sign 
the contract or telephone call^, correspondence, trip$ and other admini- 
strative^^sts connected to the consummation of the contract. Thesfi 
issues will be discussed in Chapter IV. 

3. To what extent does the TAU solicit and contract ^ 
with new clients aAd become s^lf-supporting in 

doing 3o ? ^ ji? 

In conversations with the TAU -staff it was indicated that during 
the period of study the staff , for t*he most .part, responded td requests 
which came as a result of Laboratory iGailings. Contracts which resulted 
from other than a responsive mode came about because the st^ff was . 
already in the field working on another of the components for which the 
FRDWU was responsible. For instance, the contract to provide the PETC-I 
training to a Florida Teaching Center „was secured because the staff was 
in Fldrida in^ connection with its work in the Florida Teacher Center 
dissemination effort:. During the'period of time under study, the TAU 



did not actively solicit new contracts, so we cannot answer, this 
^estion. ' • \ . 

A* To what extent doeg .the TAU develop and implement 
multiple strate^es for c|isseminatlng individual 
ITCP systems anfl clusters of systems SLuch as PODS - 
antl become self-Supporting in doing 'so? 

t 

A3 mentioned earlier, the FRDWU completed a conceptual model ttf^ 
guide dissemination ^and Viffuslicf of ITCP initructtodal systems and 
other programs or products of similar format, ' The^staf f/of the TAU 
reported that^hey consid'er themselves as guidecl by this model. Conner- • 
satlons with the staff an4 'with^sbme of the JVli/'a client;^s, (see 

\ 

questions 17 and* 18) indicate that' the staff does ^^ntend to implement 
several of the strategies descr^ybed by Arends: Field work is continually 
being dofte within* the framework of the advantages of the entire ITCP 
curriculum. Cliei^fts statjsd that they are indeed! conducting workshops, ' 
making adaptations of the materials and intending to^ use more ITCP 
products. Most of the- contracts were made as^ part of a continuous 
consultative relationship established by the TAU staff. In somi , 



instances, contracts we^e let In accordance with aclient's intent to* 

use the entire ITCP program. In other cases, clients hoped that the 

• > * 

ITCP program could be installed. 

• ' • 

The extent to which multiple strategies have helped the TAU become 

self-supporting will be discussed in Chapter IV. 

5v To what extent does the TAU maintain a continuous 
relationship with the field to facilitate any future 
needs for field-based RDD&E efforts and become self- / ' 
- supporting in doing so ? / ' * 

The staff- was. continually „j^n touch* with the field, cultivating 

future needs for additional RDD&E^ efforts. Much of this work was done 

•* 

'in= cSnjundtion with other work being done ty the FRDWO and \?as riot 
necessarily an activity unique to the TAU. As was stated earlier, most 

■ ■■ ■ Y ■ ■, ■ ■ 



TA^ work, to date h^^ come, about in a responsive mode. ' However, ince • 
rela:tion^hips were established, the sCaf f maintained them. The staff . 
was alert to opportunities to make presentations and to conduct, 
demonstrations and provide* other kinds awareness activities for 
anyone who indicated an interest in ITCP products. ' ' ^ 

Th^ period .under study 4/as not long enough to inak^ judgments, about 
the relationship t>f this kind of aptivity ^nd whether Che unit is betomir 
self-supporting. The staff reported that all of the contracts signed 
during the period under study were "in some phase- of cultivation and 
negotiation for 18 months to 2 years'before -the contract was signed. 
There appears to be a long period of t;ime between initial contact with 
a client;^ and the signing of the' contract. -Maintaining contirtklous 

• 4 « 

reJlatiouships is certainly a part of T^JJ operations. * v 
Questions Related to TAV Functioning 

^ Information for questions |( through 16 were secured by an analysis 

of the Activity Record Farms (Appendix F) , analysis of* the Cbntact ^ 

Record Forms (Appendix G), by an examination of ^he-^Summary** of Contracts 

and Ti^t/ Budget Records (Appendijf fl) , by info'noal interviews with meriib^rs 

of. the IVII/, and from the tape and Jleport of the Review Panel (Appendix D) 

Information for questions l^^a^d 18 w^s secured from the TAU staff, 

based on reports from clients. ^ ^ ' 

6. What is feh^ position of the TAU in its institutional 
environment? What components of the FRDWU, iTCP , 
NWREL, NIE and publi^he/s are involved in TAU 
activities as goal s'fetters, funders, technical 
assisters or consultants, decision makers, etc. ? 

The TAU is one component of the Field Relations and Dissemination 

Work Unit in the^ Improving Teaching Competencies Program. There 'are two 

other work units in the ITCP. ITCP, in turn, is -one of five programs *• 



in the InstructionaX Improvement Division. ' The Iifsttuctional Lnptoyemfent , 
Division, along ^wiftih th^ Evaluation, Research and Coniputer Technology ^ " 
Division, the Multicultural Education. Division, and the Educational Services 
' Division, /comprise the .institutionijl *f rSimework <>£ NWREL w|.thin which the 
• TAU functioni. The ITCP and all of its' subparts are funded by NIE. 

The parts of this fraro^worK, are Involved in t;he work of the TAU 
as fo^ows : ' ^ * ' 
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7. What is the nature of TAU-*8 institutional environment? 
Fjgw which components does the TAU draw resources of 
various kinds? What are the lines of accountability 
and influence between^ the TAU and other compbnents? 



The TAU in the ITCP. is one of a number of work units in NWREL 
which provide technical assistance with, the hope of becoming ^ self- 
'Supporting. These various technical assistance, units^ appear, to operate 
independently of each other. One member of the Review Panel commented 
that there ^re no norms^ for these units ^o provide suppotrt or assistance 
to each other. . - - . . *' 
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The ITCP inif iates and ^responds td, requests from ^outside sources 

# I- ^ * 

^or technical as^stTaflte and information. Tb? nature of its work is 

to help it^ /clients develo.p the capacity for their own training 'and 

consultatio^^ needs. Thus-, if it- does its work well, the- TAU is in the 
, > - . . : \ ^ ' . . . 

position of needing to seejc new clients constantly*. *, ' . 

The Ti^i/^utilizes the resoufces of NWREL's Office cTf .Marketing^ and 

Dissemination, the Office of Commwflltcations, tlie Media'Center , the 

Graphic Designer, as well-as tHe resources aS^aiXab]^ in all the work 

units of the ITCP. The TAU is accountable to the Laboratory for 

completion of its contract within the framework of the entire lTO(P * 

scope ^ work. It worjcs Collaboratively to establish an interdependence 

with the Offices of NfarKfeting ^nd, Comflj^ication. ^ Historically, the-TAU 

h^s functioned relatively autonomously in all. aspects^^f J.t9 scopd of . 

work. The unit look^ forward to finding ways and means of expanding the 

potentii^l interfaces *and possibilities fof interdependenc?^.with the 

Relevant components of the Laboratory. 

8. What is th^ absolute and relative size of the TAU 
^ within the FRDWU jj^ terms pf FgE^ budget>^ personnel 
V qualifications ? ^ 

' > : - < • \ 

The TAW is assigned 25%. of the time,* -bjudget and persdt;inel df FRDWU. 
The FRDWU^i^s staffed with- two full-time professionals, one full-time 
support -person and one half-time support person. In, addition, .FRDWU- had" 

' ' - ' ^ V • ' . • 

6(%)erson-days of consultant time in^ the period* under study.-. Only. 25% of 

of the^total of this time wfent into TAU efforts. -T^ie Review Panel noted 

♦ • > - * , ^ ' ^ ■ 

that the staff is too small fp iivsur^S&pth field and off 19 e coverage and 
is too small to do the necessary ^work ' load involved -In disseminating 
ihtact instructiondi systems while aC ^^Wame time acting as rfechnical 
assistants utilizing and applying the coiJlltpts and- techniques In these 
InstrilctlpnaJ. systems. * ' ' . * * ' 



9. To which -pieces of york vlthln the TAU ate personnel 
and other resources allocated? What relative and 
absolute volumes of resources are expended on various • ' 

pieces of work ? . . ^ ^ . 

J[ Th§ professional staff of the TAU have made a general distribution 

of who 'does which pieces of work, based on tljelr perceptions of thfeir 

strength's. One professional staff person responds to most of the 

requests for, information, does the initial correspondence in most cases, 

and meets with people who come to NWREL seeking information. * The other 

persf'oit does most of the contact work in the f lejd and flnkl contract 

negotiations. 

The support staff shares responsibilities for support work to be 

done, with* one exception. One support staff member manlges the budget. 

This decision was made by the professional staff ^t the time tl^e s:econd 

ons kbout distribution of 

meetings. * ' ' 

ting with potential . 
clients (e.g., phone call9<" prln^ material, oral 
presentations, demonstxptflon events, etc,)? With -\ 
what frequency and ijTwhat sequences are various ^ 
method^ ^sed? , ' 

The Activity Report vForms, Contact Records and conversations w^j.th 

th6 staff indicate that the greatest frequency of interaction with 

clients Is by kind of face-to-face activity* The next most 

fr^uent kind of interaction" is^ by phone (se^ App^hdix F) • Typically, 

a Laboratory mailing produces a request for further information, which 

is responded to. •>3Hie next activity may be a ^^^ephone call or a ^ 

personal meeting, ^taff members prefer personal mefetings, b^t consider 

tele^one' calls preferable to correspondence. ^Correspondence typically 

accompanies requests .for information, ; f6llow.-up meetings arid information 



Burroun^^g^ the details of signing -a contract. 



11. To what degree and In what ways are the methods • 
V' tailored or adapted to specific potential clients? 

. To what degree do the methods make use of a new or 
Invented channels and tvo-vay communication as 
opposed to faiifiliar or existing channels and one- 
way communication ? * 

Methods used by the-^i/ are tailored to specific potential client^ 

in the 'sense that .there are few instances of "form letters" or Routine 

correspdndence. One staf I" member commentefi that in one inst^ce where 

there ^as an effort to formulate a single response to inquiries resulting 

from a special mailing it proved to be impossible because the inquiries ^ 

varied just enough to make a form letter inappropriate^ 

^ ' The staff's commitment to .two-way communication probably accounts 
for its preference for telephone^alls and face-to-face meetings. They 

' report they have not given serious attention to. what might tie accomplished 

"with a 13c stamp." At one time, the staff considered the value of 

pre^ring a -slide-tape presentatioh, "Thej came to the concl^jision that 

the value of such a ^rVsentatlofi^vehicle would not^E^^worth its cosrt. 

One inference that could be made* from this decisipn ^s that the preference • 

• , . - ^ . ' ' ' M 

of the staff for tailoring all its interactions with potential clients 

precluded feuch a "canned" .promotional* device. 

* W.2. What cos^s are inciiri^ed by the^^^ in using various 
< methods? tfhat are the relative and^ absolute volumes 
^ of t'esourc^s expended by the TAU for these methods ? ' ^ ' 

There ^ no information avadJLabld^ t^hlch tells us the precise dosts 

of the various , methods used , by the TAU^ Some- staff time and administrative 

costs are written itito' speoial contr^acts, but there is currently no means 

of t;elling the * extent to whibh' tbese^ coatjs cover .actual' expenses jof 

delivering a contract.^ ■ y' , • * , ' ' - ' Nv, 

• ■ - ^ . . 

- ' 13 . What m^hods and Sequence's qf metlio'ds ""work best." 

i.e-., arte most ^often associatjed with potential • ' 

^ . cltenfs.who become actual clients of .the TAU ? ' . *i 
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V The sequetice (5f activities Which* culminate in a Contract are / 
typically these: 1) a request Jor information is respot^ded to; 2) the ' 
potential client displays interest; 3) the TAU will then make a teiephon^ 
call or seek oppor'tu^ilty for a face-to-face meeting. Theii there ensues 
a generally. long period (12 months to 2 years) of cultivation, which . 
usually entails more telephone calls, person-to-person meetings, consul- 
tation about the proposed cdhtract, help wfth identifying funding * 
sources, and /on* allocation of resources to the project. Negotiation of 

. specific contract el^ents is a part of this process. Finally, all 
necessary elements have been negotiated and the formal contract is 
signed. . t 
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1^- What are the demographic features (age, position, 

' r^ce/ethnicity, location, a.cademic background, ' , 

r experience in educ^tion» previous experience with 
NWREL, ITCP or instructional systems, etc.) of 
• potential individual clienft that most 'of ten are 
. associated with becoming actua l individual clients? 

^ ^ 

^ The persons most likely to become clients of the TAU are persons 
« * ^ 1^ - 

in school districts, universities and other 'educational administrative 

units who are directors of projects, coordinators of trainings directors 

of ^fetaff development,, or administrators.^ They are located in widely 

separated" places, from Hawaii to Virginia, British Columbia to Florida, 

California '^^Massachusetts. Some of £hfem hive participated In one or. 

more' ITCP instructional system^. In some instances, they were present ^ 

at an ITCP presentation. In others, they heard about ITCP from a colleague. 

; While concrete information about their academic background, ethnicity 

and age are, ijot available, they have the prerequisite background and 

expe^ence t9 hold Administrative positions in educational agencies other 

than school btildings.- ^ • 



15. - What are the demographic features of decision 

, makers most often associated with conmlttlng , 
dthers or the -agency to "be an actual client ? " 

t • We have no' Information about these -persons- other than reported 

In answfer to question 14. " ^ 

• * - ^ ' 

16. Whajb are the' ciemographlc features of agencies 
(size, I^atlon, locifs of decision making, 
type \)f agj^ncy and previous relationship with 

NWREL, ITCP or Instructional systems, BtcT)" ' ' \ 

most ote^n associated with l^ecomlng actual • • 

agency clients ? ' ^ > ' ' * ' 

The agencies range la .size from a large. -state de^partment of education 
to a teaching center that services one county, and from a large school 
district to a program -within a district. Tl^e agepcles are typically 
administrative units wlfh training and staff development functions.." 
The individual from the agency contracting with the TJ^U frequently has 
contrt)l' wer a training budget, so J^hat going to another decision making 
source is not necessary. - ' ' , ' * 

In most instances, personnel within the agency Itself have had seine 
f:^{*t-hand iBxperieni:es with IT^ i^iroducts, even though the, entlr.e agency 
may not have participated in'any^ af the instruct Ipnal systeijs. * 

17. According to the, reports ef actua]^^€ll^ents , 
through what "methods did they beconie aware ' ' ' 
of the TAD and decide to* make use of its 
products and serviq,es ? 

Telephone interviews were conducted vith 5 of the 7 persons who' • 
contracted^ with the TAD during the- period under study. .In each. case. 



awarenfess df the TAV came about.dif f erently, as follows: 

I 1. A school district superiritendent had known about NWREL 
through the Lab's connection wlth^the University where 
he did his Ph.D. work. 



2. A superintendent of An educational services district 

had known about NWREL from its inception, studied NWREL 
publications and lnvlte4 TkV staff to lAeet: with his * 
advisory group to explore the advantages of using ITCP 

' currlculiHn. ' ' . . 
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3. An ^administrator in a ^tate department of edycation 
^ heard. about ITCP from another administrator who had 

participated in a workshop. - ' • ^ 

4. ' The dir^BCtor pf a teacher education center found out 

about ITCP when % TAU staff persoti' was ±tt his state 
on other^, business and made a presentation. 

• 5. The coordinator of training for adminid^ators in 
a large school district found out about NWREL an<}^ 
' ITCP- products and materials about two years ago 

^ through \ member of "his committee which has the 
task of planning a training ptogram for admini- 
' strators and li^ere developing a bank of training 
resources. The* coordinator has decision making 
power unless the amount' of 'the contracit exceeds 
a Q.ettain amount, in which case he must g^et the 
approval of the , super inteadent. ^He^ reports the 
approval is readily secured, since the^superin- • 
tenant respects and trusts his juc^gment ... 



JtT one case ther individual was in a position to make the decision 

and proceeded to negotiate the contract. In another case, a considerab! 

amount of government clearance and achieving consen^sus among staff 

involved was required before completing the* contract. In two cases^ 

tlje individuals secured the approval of a group with budget authority 

before the contract was signed. ' 

, ^ 18., According to the reports of actual clients, in . • 

what ways do they intend to make use of >the 
instructional systems and the T((X} in the Tuture ?- ' " 

The five clients interviewed varied in their respdhse^ to this 

>' ' ' ' ^ 

question, as follows: '* 

>' , 

1. The district superintendent indicated he had'np 
specific plans for- using the* instructional sys^tems,- 
but intende.d to work out some training and had made 
some adaptations of one of the ITCP systans with this 
in mind^. He had no plans to 'make further contracts 
with the TAU. . , ' ' 

2. The superintendent of the educational s«i;>fice& ' ] 
, ^ district said that he had a tentative commitment ' 

\ with the TAV to^use the entire ITCP curriculum to 

prepaf^a^cad^e of trailers. He said wcrtfkshops were ^ 
being coriducted at this* time to that end. 



3. *rHe administrator ;ln the state department of ' . ' 

* . ^ 'education stated that while the workshop had ^ , 

'rr^ ' been very practical arid usefqj. for the partici- 

pants, he was re}.uctant ^to'say the services of ^ 
the TAU would be contracted f or again. He cited ^ ' 

the cost ^of TAU services as being a block to * ^ ' . , 

further relat;ions»f{) with the T/tU. . ' ^ 

^ ^ \ ^ * 

4m The director of a teaciier education center * * • * 
.declared that'the skills. represented by ITCP \ , 

materials *were desired for: the disti^ict, that 
^ in his district systematic wo rit was bein^^one ' ^ 

to prepare educational consultants, and ^it * , 
he intended to c^otitinu^ to use the resoui:c.es ' » • 

: of the TAU' to meet his objectives, • • ^ \ 

«» 

5% The coordinator of • administrative traiaing has 
already, had people trained in mosr of Jhe ITCP 
• products and ha^ selected some of those traitiers ^ ^ ^ 

to conduct othfir workshops in^ the district. ^ ^ 

Althqugh this is not being done syjstematically 
at the moment, he is currently doing the necessary • 
internal work td. develop a small cadre of people 
to becOTie organizational specialists for the 
district. He plans to. continue to use the " * 

resources of the TAU once or twice a year as • . : 

part of his' total trafning program. 

Questions Related to Evaluation Procedures: * , ' 

The Informaton in ^questions through 21 was secured by data 

analysis sessions (Appendix E) with the TAU staff and by informal * 

interviews with the TAU, ITC? and NWREL decision makers. 

19. To what extent ate evaluation procedures specified 
in this dgpign carried out as planned ?' ^ ' • 

The evaluation procedures were carried out as planned with two 

exceptions — Interim Data Analysis Sessions and the Postsession Reaction ' 

Questionnaire. The Interim Data Analysis sessions were attended only by 

TAU staff and the evaluators. The evaluation staff did not use a quesfeion- 

naire, tSo did not compare the results of TAU interventions with'ERDWU 

activities in IGE schools and the Florida Teacher Center Network. 

20. What factors account for deviations from these 
procedures»> if any ? ^ ^ 
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Three factors account for the deviations from t'he evaluation 
procedures as designed:' the shortness of time, 'the TAU slaff's- heavy 
involvement in other FRDWU and ITCP activities and budget restric'tions. 
^ • T^^e three factors created problems of, having to cancel scheduled- 
nneetings, of being unaile to involve other ITCP and NWREL personnel, 
and of having insufficient funds to construct, administer and analyze 

^ ; ■ c ■ ■ 

a Postsession Questionnaire. \ 

\ > y 

, 21. What do the TAU^ ITCP and WREL wish to recomnend in 
terms of future procedures for monitoring the feasi- 
bility and functioning of the TAU ? ' ^* 

The TAU recommend that a full-time coordinator of TAU- activities 
Be secured. The coordinator woulk^have full salary and a travel' budget, 
thereby malcing it possible to make the contacts and ddHthe negot^ting 
for contracti needed without the necessity of having to generate salary 
and travel funds. The TAU staff recommends further that an evaluator/' 
/ documented be secured at about% .25 FTE level to work with the 

coordinator so that adequate documentation and continuous evaluation of 
TAU activities can be done. *' * ' 

^"^^^ is in general concurrence with the recommendation .of' NWrREL ' • 
(see bellow), but_ would like to suggest considering the creatJ.on of a 
[/aboratory-wide.JMi/Zdissemination unit for mature products. ITCP 4s 
two reasons for this recommendation: ^ . • 

1. 5ome of th^ "front-end" costs of creating awarenesa^^ 
program materials, establishing personal contacts 
to explain and translate th^ program values. to the 
unique tieedS of the client,' ahd negotiating contracts 
might be*- reduced if TAU personnel from a number of Lab 

' programs wei>e briefed about, other L^b services and 
products^ , ^ j - 

2. The deftiands which ongoing R&D programs make on 
dissemination staff often conflict with the needs ' 
for establishing a self-supporting TAU. For example, 
the R&D program may prefer that staff time b*e spent 



27 



writing reports describing field work plans to 
satisfy funding agency requirements and hence 
secure funding, while clients, require face-to- 
face, meetings in the field to explore felevance » 
before signing contracts. r 

NWREL is of the opinion that a TAU a^pear^ to be feasible only as 

an adjunct to an on7going program within the Laboratory, This option 

r 

is based on the observation that while the costs to actually deliven 
technical 'assistance and training can be supported by the field, the 
initial costs which culminate* in contracts are probably not recoverable 
unless the volume business is quite high. ^ 
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CHAPTER IV: . SUMMARY AND DISCUSSION 



This chapter contains a review of the evaluation methods and a 
discussion of the findings. It concludes with some reccmHnendationS' to 
'the various audiences t;his report addresses, ^ / 



Review of Overall Ev aluation Methods ^ . 

^ ' — ^ 

The evaluation methods were Revised in such a way as to secure 
full participation of the TAJX staff in this study, with the assistance 
of two evaluat^n staff and to ensure the likelihood of securing the^ 
information needed with minimum additional effort by TAU sr^tt. 
* ^ The methods use<|^ f or securing Information included the following: 
1) the TkU staff completed two forms: Activity Record Forms and Ccmta*t 
Record Forms*;' 2) the evaluation staff conducted periqdic interviews with 
the '}!A\} staff; 3) both staffs coilSucted Interim analysis sessions; 
4) the evaluation sta^f collected documents relevant to the TAV work, 
such as ITCP budgets, proposals, scope of work statements, disseminati-on 

materials, correspondence with clients; 5) a Revifew Panel was convened 

/• < * ' ^ 

to react to data collected and to make recommendations to the TfiO. 

Discussion of the Findings . ' , 

In this section of the chapter, the evaluation findings will be 
discussed within the framework of the prganization of the eval'uatioa 
question^'. First, the findings related to the feasibility of the fAV 
will be dis,c4ssed; second, the findings related to T^d functioning^ will 
be discussed; finally, the findings related to the evaluation^ procedures' 
will' be discussed. — 

Feasibimty of the TA\] . The period of |eight months to -study the 
activities of the TAl] did nrt provide sufficient time for an adequate 
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range jDf activities to occur nor to make possibJ.e the collection of 
information to fohn any opinions aboiit the 'extent to which the TAU can 
become self-supporting. The evaluation questions related to the feasi- 
bility of the TAU cannot be answered at this time. ^In ad4,ition to the^ 
short period of the study, the limited allocation of staff time and - 

\budget fq^ TAU activities during the period of sjtudy has contributed to 

■» 

^the smal^number of Activities and data. Twenty^five percent of the 
FRDWU budget for st^ff time did not provide opportunity for^n adequate 
sample of activities and events that would generate vaii^ and sufficient 
^information to, help- arrive at conclusions concerning* the feasibility oif 
the TAUy including its self-supporting, capabilities . 

In taking notice of the feasibility questions and the issue of 
becoming self-supporting, t\\i Review Panel also pointed out that the 
anlount 'of money earned by the TAU d\iring the periocf of study, which 
almost equals the amount budgeted for the TAU from NIE funding caimot 
be used as a useful criteria for extrapolating self-supporting capabili- 
ties in the future. There are a numbyer of reasons for this ju^igment; 
. 1) budget an4 time allocated to th^ TAU staff was a basic 25% of the 
FRDWU budget; 2) it was impossible to keep ^^areful record of actual 
costs of TAU activities because of the interdependence and clol^ inter- 
relationship of the 25% af time allocated to JVlt/^ activities and the 
• 75% of the staff time allocated- to th^ other activities the staff ^ 
conducted in the total FRDWU; p the special contracts secured by the' 
TAU between May and October, 19^6 paid fof the actual delivery of the 
contracts, plus a small amount called "occupation costs," for some staff 
time 5)lus the standard NWREL 'ifidirect costs; (not all costs telated to 
the negotiations .and administration of the contract, i.e., promotion, 
telephone calls, consulting are ijaid f or ,in the contract. For example, 
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The "occupatioij cost" figure contributes to space, telephone, faciliti 
planning, adapting time and other administrative costs to be able to 
meet contract, terms); and 4) no provision for staff development and 
maintenance time has been accounted ffor^ 

It seems clear that without other resources to 3ijpport marketing 
and staff development activities, the TAU will remain unable to fully ' 
support itself. The iTeview Panel was quite clear in its opinion that- 
the TAU needs to collect more information for a longer period of time 
about what is required to operate ^ TAU y particularly information 
derived from a precise and careful analysis of all aspects of the TAU 
operation* It must be .stated that given another year of study with 
increased sophistication in record keeping, careful analysis of cost 
effectiveness, and increased staff time allocated to TAU activities, 
the possibiUtfes for getting answers to the questions concerning., the 
extent to, which the TAU can become self-supporting would be increased. 

Functioning of the TAU . This section contains a discussion of 
findings about how the TAU functions in its institutional environment, 
its intei:actions with its clients, characteristics of its^lients and * 

what it3 clients report about it. ^ 

;1* Institutional arrangements * ! " 

' The TAU does its work within the ITCP, using some other urjits of 
NWREL as r^esourcesl It is one of^a number of TAU^8±n NWREL, all of 
which appear to be functioning independently of each o%^r. The TAU 
was assigned 25% of the time, budget and^'personnel of thje FRDWD. Th^ 
TAU staff spent the other 75Z of their time, budget, personnel doing 
other FRDWU work. The TAU' has made use of six other resource personnel 
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on a consultative basis. These persons received assignments in meetings 
with the TAU staff far different aspects of the TAll scope of work. 

Planning, allocatioa and coordination of resources are aeconipllstied 
in staff meetings where each person accepts assignments for parts of 
the work. « * ^ 

Given the limitations of a small staff and budget, the TAU has * 
performed remarkablv well. It is logical to conclude that given its 
achievements, based on a 25% budget/time assignment, the TAU could 
produce increasingly greater results if^the staff ^had the opportunity' 
to focus on the 3Vli/ activities only. It is quite possible that the « * 
TAU could iJrofit by intensif ying^its effprts to interface with other 
TAU ^8 in NWREL and work in the direction of interdependence ^th these 
units. 

'2. Interacting with Clients 

The TAU prefers to work with clients and potential clients in a 

personal ^y, tailoring its approach to clients^ n^eds.-^-^e methods 

used most frequently in contacting clients and negotiating extracts 

with them were face-to-.face meetings and telephone cdlls. Most of the 

time a: personal meeting with clients necessitated ^ trip, but quite a 

number of the meetings vere^conducted in connection with trips taken by 

/ I 

the staff to^ conduct other FRDWU wo^k. The use of correspondence as a 
method of interacting with clienjts is minimal. It is usually employed 
to answer requests for information, to communicate details of a contract, 
or to follow-up personal meetings and phone calls. The -costing procedures 
currently used by the TAU do not include information about the exact 
costs, time and resources expended by these methods of interacting with 
clients. . ' , ^ 



Althougli there is no informatic^n about tfie cosC-ef f ectiveness of 
these methods, it is evident that the TAU is using ?n expensive method- 
ology.for interacting with clients. A plan for collect in&^^^ormation 
about the cost-eff ectiveness ^of this methodology in terms of time, 
expenses and number of contracts secdred would be u3eful< The evaluators 
recommend experimentation with other methodologies, iircludiig a precise 
cost accounting, to make comparisons with methodologies curtlently in • ' 



use. 



3. Characteristics of Individuals and Agencies jtfhp became 
TAU clients ^ 



The persons ana agencies who became TAU clients during the period 
under study were ^fl34f^y^ersons in staff development arid administrative 
. training working within rathet large educational agencies, such;as 
school districts, teacher education centers and state departments of 
education. The clients were widely dist)erse extendin^rom Hawaii to 
Massachusetts, Washington to Fidrida.- The clients usually had had sblhe 
experience with ITCP materials in workshops or demonstrations. ' In a ' V 

few instances, -they had heard about ITCP f rom^soliepne who Had ^d f^st- 

• . ** "Ti" ^ * ' 

hand experience, of ITCP materials . In one instance, a client had 

■5 . . ^ 

<* ' , - * 

participated in the work that resulted In the establishmetnt of NWREC. ' 

It would appear froilf hi^ inf ormatign'trfiat'^ehe TAU will be Vdat 

successful in securing contract^ f?om j)ersons who have decision-making 

and budget authority or* who can influence c^ecisions and. budgets.- Contacts 

.with the TAD th^t have not tesalted in contratfta generally originate 

with individuals ip school buildings or In other' agencies who do not 
* . ' » ♦ ■• , ' 

have decision-making and budget power.' 

^- , The information also, suggests that the approach used by the Tfi.U 
results ih contracts yith **the estabiishiilent*\ Such an approach could 



use dlflj^culty iT\ being responsive to th'e "grass roots" individuars 

-. " . . ^ - • . • • : ^ - - 

who are interested in personal and 'prof essional growth; J'he cli^emtelfi ' 
. of the TkV is tiius'.maVbe ^raited to the^'individuals and agencies that \ ' ^ ^ 
#haye th^ capability ^to decide tlie allocation of r;esources and,»time 



activ iri^s with \he TAU, * - . ' * ^ 

• 41 ^Reports from client 



Clients found out. about ITCP materials in a number of ways, , k 

* inqj-uding by word-o%-mouth, through demonstrations, by reading and , 

. - m ' ^ ^ 

respondj.ng to NWREL mailings and because^of long-time knowledge *of 
^NW:iJ^L. In all cases', tjhe ^clients either had decision-making and, budget 
power or had great inflxj^ence on- these ptoc^ses, l ' ' • » 

In each casej tlje clletit expressed satisfac£ion with' the quality ^ 

. ' ^ ' > ' '* ' ' 

of the^services performed by the TAU. Half of the clients interviewed^ • 

\ indicated their intentions toaOntinue to'utilize ITC? materials in ♦ 

/ ' ' ' ' 

training cadres of trainers 6r 6tganizational spectajia^s* and to seek • *f 

the services of the TAU. In the othdr half »iterviewed, the clients 

W^i^U^ble to say that additional work with th^ TAU would '{je sought* 

'X • n y V • ^ 

X ^ It may be xhat clients whose o^^^ctives include preparing a cadre 

^ of persons to "do, training or organizational work are'^more likely to 

bfeccnje ^'continuin/ client^" than are people whq are interested in just 
one training event and have no jplan for systematically buil4ing in a 
dapacity to pfoyide training and organizational work internally. -We ' ' - ' 
^ have t;oo smdll a sample to ^entur* this kind of a generalization, altsfcough 

" « * ' * . ' - . ^ 

it adeems logical-to conclude that ^otenfrlal cliAts who hav^ the desire 
J " tb build into their, system the kind of training capability ITCP materials ^ 
^ can provide, and are making systematic plans to that end, are quite 
likely to l6ok for ways and means to. utilize the serv^^s of the "J^U 
and. materials' produced by ITCP. , . , ^ ' 
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Evaluatloff Pxocedtires . In this section, the findings regarding, 
the extent to which tH? evaluation. procedures were followed, deviations 
from, the procedures, and recommendatiohs regarding thfe future procedures, 

' for monitoring the TAU are discussed (to be supplied in conjunction with 

- the NWREL Review). . ' . 

Conclus| j^ ns and Recommendations ' ' ^ - ' ' 

The eva^tbrs are of t^e opinion that it .is impossible to give 
good advice basfed on the data collected during this' study. There are a 
' number of^aioi^s for this^ btlief . ^ ^fcf:, |he interconnection and Inter- 
dependence of th^ri4Jf with.the of her (^poneiits iit the FRDWu'make 
identifying clear 'distinctiops between them e:?tremely difficu-lt. Second, 

• r « ' , * 

eight months of study is not long, enough to reach conclusions. For 

instance, ^^^typical time span from/ con taji^ to contract ^ 18 months to 

two years. ^Third, the tiae and budget assigned to the TAU^ for this 

study-was inadequate. Fourth, the b\idget assigned to 'tjie Valuation 

staff precluded some' kinds of activities (i.e., securing ^xterft^l ' - f' * 

consultant g^^r the Review Panel).' The Outstapding resuj^t .'of ^the'' 

evaluation study is* that more study is needed before conclusions can be 

reached and generalizations made. It is in this framework, ^that.the • 

eyalij^pplrs prdBent some ver^ tentative recommendations to thf TAU,^ ITCP * 
' . • ^ ^ ' ' ? 

and NWREL. > • 

,1 , *' ^ ^ ' ' * f 

1- . Deveiap a co^t bracking system for all the functt/ns of' 
the !PAV wMch will pro^de inf ormAtionJconcernin^staf f" 
time exiiended^^ifect costs, non-direct costs £6r; ' 

a. Marketing , intludiiig advertising^ ^ace-to-f ace , 
contacts, consultative -selling (selling t^sed ,/ 
on diagnosis 6f^ plient needs and desires)r> 
* • ^ ! presentations and demohst rat ions, contt^ct ♦ 

negotiations, telephone selling, .correspondence, 
^following-up on contraflSt;^ other administrative 
^ " cost6 related to securing contracts. ' 



Providing the Technical Assistance . Including 
planning, customizing; staffing, the contract,^ 
. J)delivering the^ntract, consulting 'with the 
" client. 




Maintaining, the Staff , including staff meetings, 
staff renewal, supervision of staff ^ negotiating 
.with tfi€L institution, staff development. * 

2- Engage^i n mop^ comprehensive documentation of the TAU 
" 1 activiti es so^ that more .information is available for 

4 assistanc e in mAkiog decisions abo ut the future of • 
. >^he TAU . . , : z — ' 

a. Develop criteria for nilaWng judgments about 

^ ' ' potential cfients^ i.e., what makes it worth. 

pursuing the uniqueness of a potential client? 

b. Design and utilize a method for evaluating 
contacts as to their "hpt-itl|^s" or "cold-ne^s" 

' which will be continually changing with tta^ ' . 

ya-lue of the contact for eventually securing 
^ ) a contract. ' 

, • c. MainCaitt ^ documentary' account, of the activities 
. , - -whi^ lead to a contract , Including tiates when / 
^iJi^al^gontact was made and wherv the contract 
was signed. - \ ^ 

Si. Make an analysis of the kinds' of contacts 
^^which eventually produce contracts, i.e. ,' 
/ . presentations, NWItEL mailings, experience 

with ITCP/NWREL products atld materials, word- 
of-mouth, ERIC, search, 'personal contact. 

-^ 3- Reconcept uali^f, cUrify^ sharpen the^mlssipn' and 
m^iission dbjectives of the g!4[/i especially as they 

♦ relate to the. Implications for the TAU as to whether / . 
to fconcen trate og. selling ITCP -products or to> place ^ 
emphaslswon^roviding- services to clients to help 

buUd in an internal capacity for feelf^renewal . 

V Provide suppoirt for the TAU in, the lars^er NWREL * 

structure by making the TAU an integral part of 
that structure, in company with other similar TAU ' 
: operations, possibly house^in the Educationar ^ 

* Services Divi sion. 

— » ^ / ^ 

^fhis recommendation arises from a discussion in the Review Panel 

during which three points were made: 

- ' i. " • ♦ '^'^ , 

a. Other TAU'a^tn NWREL have* ^imilat problems to the • ' 

^ • ItCP TAU, bub there is no mecftanism for thesa^staf f s 
t<5 get together -to help each other. . w 



* b. If all the NWREL TAU^a were^ housad in one admini- ' ^ 
sti*ative pjace, the chances far helping each other 
increase their business would be eahanced.^ For 
exatnple, staff of one' could be alert for 
.^potential clients for the staff of another TAU^ 

c. Under an arrangement like this it might be pos^l>le 
to. establish a 2Vli/ -which woul<^ .focus on providing 
training^from a lab-wide point of view, 

5. Secure funds to make the TAU a separate and distinct 
. , ilnit from the FRDWU with the following staff; one 
full-time professional, % time professional and 
}i to fulJU^ime secretary * # ' • 

It is our opinion that until the TAU is completely separated from 
the FRDWU it wii'l continue to be extremely difficult to study its * 
function or its f e^sibility-w " . * • ^ . 

The reader of this reporf may want to refer to the Report of the. 
Review Panel, Appeadix D, for <|dditlonal stateii>ents of advice and 
recommendations. - ^ 
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Appendix A: 

ESTABLISHMENT OF A TEC 
ASSISTANCE UNIT 




V : 



, , ' COMPONENT- #5- * . ' ' * 

- ^- , , ■ ■ • • /. 

■ ESTABLISHMENT OF A TECHNICAL ASSISTANCE UNIT 

Establish a technical assistance' unit as an adjunct to Program "100 
to facilitate the 4.riltia'tion, installation, implementation, 
utilization, continuation and diffusion (IIIUCD) o? the IT.CP 
instructional systems to any potential users. 

» • ■ • ■ ' 

One (M our aims is to disseminate training in l^mproving Teaching 
Competencies Program Ijistructionai systems to help bring about^ » 
change in behavior of individuals, small groups, educational 
organizations and subsystems within educational organizations. 
In order to catry out this aim we need -to provide technical 
assistance to help clients understand" what the instructional 
systems will and will not do, how to install them, what needs 
to "be done to adopt or adapt theni, how to implement them, how ^ 
\to utilize them and how to stabilize the efforts for maxloum 
benefits to accrue to the organizations. « 

- ' " ^ V . 

Another aim is to study the process of installation, initiation, 
impl^menTation, utilisation, continuation and diffusion of 
ITCP instructional systems. 

A third aim is to build bridges for the future. One way to 

build a bridge for the future is to establish a technical 
> 

as^stance unit as part' of the Program to solicit, and respond 
. to interested organizations or grmips who wish ta participate 
Kr one or. more of ITCP instructional systems. 



Objectives: 1 To provide technical assistance for any interested users 
^ ^of ITCP instructional systems*. 



2. To ensure/facilitate the IIIUCD process on a shared-cost 
or a total cost contractual basis. 

3. To solicit and contract with new clients. 



4. To develop and' implement mul.tiplfe strategies for carrying 
out the IIIUCD process of ITCP systems and clusters of 
systems, e^.g,, PODS. 

5. To document, study and analyze strategies used and/or implemented 

6. To determine the extent to which this Technical Assistance 
Unit can become self-supporting. 

7. To maintain a continuous relationship with the field to ' . 
facilitate any future needs for field based RDD&E efforts, 

8. To reach a shared understanding of how ^Ijis unit will interface 
with other Lab administrative units, e,g.. Office of 
Dissemination and Marketing, Educational Services Division, etc. 



\ 



SPECIFIC TASKS 



ESTIMATED - 
TIME REQUIREipJTS 



1. Beslgn a plan for the establishment 
of a Jk unit as an adjunct to 

Program 100. , 

/ 

2. Get plan for TA unit approved: 

* . 

2a. Hold a meeting with 
appropriate NWREL 
administrators to ^present 
plan and get reactions. 

* \ 

2b. Modify plan based on 
administrators input. 

'2c. Hold meeting to discxis 
• revised plan. 

3* Develop guidelines for appropr£ 
responding to individuaLs, groups, 
and /or organizations » technical 
assistance related to the ITCP 
instructional systems 

4. Develop multiple strategies for 
carrying out the IIIUCD process for- 
iTCP systems and systap clusters . " 

5. Implement multiple strategies 
%dentnfied. 

6. Develop a plan for Identifying and , 
obtaining new clients. 

7. Implement plan for identifying 
and obtaining new clients. 

8. Documantatioh of activities and 
events . 



10- days 



7 days 




4 days 



-J 



/ 11 days 



30 day 



11 da^s 



30 da^s . 



9 days 



4S. 
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FLOW CHART' ON ACTIVITIES 




Activity 



Task 1 
'fasV 2 
Task 3 
Task *A 
Task 5* 
Task.> 6 
Task 7 
Task 8 



J 



erIc 



Jan. Feb 



X 



March April May June 



XX 
X 



XX 
XX 

X 



XX 
X 



;cx 

X 



July 



August > 



Sept. 



Oct. 



XX 

X ' 



Nov. 
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ACTIVITY RECORD FORM 

V 



\ 



Work Unit Activity: 



ACTIVITY REPORT FORM 



Person Reporting: 



ite: 



Length of Activity: 



Date(8) of Activity: 



Other (8)^yolved in Activity: 

Program/NWREL Staff: 

Others : 

Name(s) 
^ 



Address & Phone Number 



Position/Organization 



(key persons) 



Relevant Preparation r 

Type of Activity; Telephone 
Purpose of Actllity: 



Meeting 



Tine Taken! 



Other 



Description of Activity 4 



Plans for Action: 



Titae Estimated: 



ft 




Apijeftdix €: 
(CONTACT RECORD FORM 




CONTACT RECORD FpRM 



' State: 

Agency: 

Name: 

Address: 
Phone : 



Known Characteristics 
\ of Person: 



Date 



Known Characteristics 
of , Agency: ^ 



Date: 



Initiator /Activity: 



^ • ."^^y \ REPQIRT OF the;. REVIEW PANEL 



■f ' 



^ > « 'The Review Panel' met all day on» Ne^vember 5, J.976. In attendance ^ 
* 'j^Were the pralgssipnal and Support staff 'of the TAU^ the director, of 



. NWREL^a Division of Educational Services, th.e Director of- the ITCP, 
gfwo piro|es«ional staff from tfee NWREL^ Rural pducati'on Program, one • ' 



. f ^ person from C 
^ «f *E4uaati6n, 




C'fiPilP^JJg^ersity of Oregon,, one person.*from the Department 



UniverKty^^of Oregon and two ev.^jation staff. 

^ I ^ ^ "The Review Panel was askfed. to^dress it'dttlf to ajita^ic framework: 

. — . 1. What^ i^'^equired ^r a well-functionirtfe TkVI 

^ 2. What appear to be ci^lftcal activities for a TkJJV 

^ ^ ^ . *3; What,hunche3 ot advice sHould be con^dered by ak 
4I ^ TAU if it is to become self-supporting? * 

^ The evaluation questions the Rgfview Panel was asked to focus on 

" ' * were ntSnjberS 1, 2, 3; 4,' 5 11 and 13 found in Chapter 2* of thi;3 report. 

fir Members of the Panel were provided \d.t!K a'list^of the evaluation 

qitfefftlc^s , ^ a s tateme ^p.^f ^the context of * ^(Revaluation, summaries and 

analyses o^ Activity Record Forms and ^Conta-ct Record Fprms ^ind copies 
tr » * \ ' * ^- 

of not^s made during Int^erim Analysis Sessions, '^V.^.-^ ' . 

^ The Panel cont:lud^d^that the TAU was generally on th^ Vight track 

- in i^s^fforts to 'facilitate the initiation, ^st^llatidn/l implementation, 

^ • ' . ^' ' 

utilization, cofitlnuaticfp and diffusit)n^o£"the ITCP' pWdiicts. However, 

' , . the^ period of stiidy wfs-riot lengthy enough or of sufficient depth to 

produc,e needecTlnfon^ation to establish whether or not the TAU i^' 

' * presektly#cdj|rtdtuted can become self-suppOTting^- ' The Panel spent much 

' of its time, in a discussion based o^ the phrase, "and bec^e self- 




so,'* f6un^/-Iift>i^ feasibility^ section of the 
e^^■Hjt^t^: (faestidns/- ThefPanel also noted tha^ne 



7 . 



so noted th^k^ie^' for. more data over 
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a longer period of time before generali2ationn^an*be made^ Attention'. 

was^also paid to the extent of *drid need for ^featet interd^pendance with ^ 

other TAV-'Uke units in NWREL. Finally, the Panel had some woj^s of " 

- > ^ ^ ' ^ * - \ . 

advice for the TAU and some "hunches'' to share about wha# would- ba- 

J 4 ^ V • ^ ' 

needed for the^ TAU to be successful. • ^ - ' ^ \ ^ ' * % 

, ^ The Panel concluded that in order for judgments to Be jnade abqut ^ 
the feasij)i^ity the TAU, a more- detailed accounting of the actual 
costs of tfee ^AU over a longer period of time' was needed. One membfer 
noted that there appeared to beiiat le^st three major functions in the 
TAU — marketing, ^^vidin^ the technical assistance and 'staff niaintenance 
and development-*-of which spetfial contracts only generated funds for. 
proviaing the technical^assistadce,. or Jthe deliyety of the. contract 

' ^ ' ' — — .Sr" . 

itself. X^e .PSnel made some reteommendations; about A mo.re' detailed * ' ^ 
documentatJ.on<^dKCost accounting f (jr 'tjle- three maj^or 'kctivtfies the') 
TAU needs to ke'ep ±vi ^ind| as it continues to develop^|These * .'^ • 

recommendations are in(^luded in €>ie 'last, section' of this retiort.' ' > 

The members of the Panel were. convinced that clients would be 
unwilling to pay.^ll, or ev^h a substantial pajft, of the' expenses inc^red 
in marketing and in s^aff njaintenance apj development. An implication 
-is. that t;he 24i(jriee4s any economic base which can provide funds^ for the 
real costs it incurs. Illustrations of tirj^ups like the TAU vbo have ' 



an economic base^ are .those who publistj^ materi^f^Bf^rtio have university 
positions. ' ' ^ . 



Members ^of the fkael noted t^at the problem of the TAU then became 
one ;of ^ejtauading NIE, or some other futiding source; to sup^rt th«^, ' \ 
TAU marketing and staff development funcjcions.- iHe ^other ^It^efr^ative' ' • 
seems to be to becoi!^ highly compet;.itive and posses'give ot it a resources. 



Su^h an, alte^atflve is contrary--to the value system of the TAU, which 
i§ Inclined to ,wai|t to find ways to provide clients with what they need. * 
The -Panel discussed the dilemma faced hy the'fAU due to its intferest 
In provid44ig technical assistance that builds in a capacity in the* 
•organization to beconje increastngly' self-^uf f ipient by acquirihg the 
^ternal 'capability for problem solving, and ttie necessity faced by the 
TAU of selling serines in torder to survive* The conclusion is that the' 
more the TAU chooses" to functioft i|^^s preferred mode of operation, the 

fewer the return calls from clients. ^ . ' * 

•* * 

The Panel- noted tjiat quite' a nximber of TAU activities resulted from ^ 
contacts made when the -staff was already in the field on some of its 
other business5f further obscuring actual costs Of- operating the^TAU. 
'For 'this and other reasons, the Panel made so^he "orecqpaendajtions regarding 
a clearer dif fet^ent^iation between TAl) costs and costs connected to * 



other FRDWU activities, these recommertd/tions are inciiid^id in the last 

' / ^ ^tk ^ - : . 

section of this f-eport. ' • 

Members of * the Panel expressed the opinion that the T'AU wOuld be 

• - , ■' > * " • - • 'j' 

well ^<fvised.to rethink their methods of accounting* for time and costs ^ 

of achieving 'TAU func^ons. For instance, i^w much tim^is spent in' 

• * * ^ 

marketing, i.e;, advertising, face-to-face promotion, consultative 
, selling,, making presentations, telephoning potential clients^? What do 
these activities cost?* How' much time is spent and what does it cost,/ 
to deliver the contract," i.*e.'', planning*, adaptation, customizing ^o the 

neads of tTie client, actual delivery of fhe serviiae? How much time is * 

^ • . . - ' > -I ' . , ^ . 

spent, and what dfljes -it cost, to maintain the staff, .i.e.,* staff 

development, staff .meetings, staff renewal/ responding to institution^ 
requests? One mfember ,Qf . the Panel characterl;2ed this kind of .accounting^ 
as functional accounting. The^ opini9n was offered that this ki»nd of 



accounting t^oulcT produce a -mare accurate plqture of how the *"SV«^ 

' ' 

f.unctlons than its present system, and would be W useful base from 

Chlch to make decisions Iffiut the 214^ " 

' "■ ■ ' ' • . ^ ' • ' 

' . ' One .issue considered by the Panel "arose- |^6m a discussion aboiit the 

^ • ^ ' ' ■ ' '■ 

institutional arrangement^ within which'the TAU does its work and the -* 

# ^?f#«ct. this" arrangement has on the taasibility of the TAU. It was- noted 

that, other TAU'a in-NWREL face ^problem^ /quite" similar to the TAU in ITCP. , 

However, staff ^,of theaa' TAU'a d<i.not meet- together to work on common 

"prablems, -ridr do they appear to support each other One m^ber stated * 

an opinion that the various r^i/'^ -did not see this. kind of activity as 
^ being in their best self-interest. The perJ;eption of sorfe members o*f '■ 
the Panel ±^ that iJwREL does not provide sufficient support and - 
'CQQrdlnat'lon |or Its TAU' 6, - • ' ' " , , ^ 

^Throughout, th% meeting members of the Panel offered advice, and 
recommendations •to the^m. There were a number .Qf "hupches" offered. 
Ttie flnaJ. section of Uils r^pprt ll^ts these. . # 
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*recommem)ation6 and hunches 

Intetnal Functioning of the TAU ' » « ' 

1. Devise a cost tracking systepi to determine the "r^l'* 
costs of doing business to include: 

Number dnd cost Qf telephone calls, letters, 
. meetings, trips to secune a contract! . . 
' • ' ^ ^ ' / ^ 

^ ^ b. Administrative costs incurred in delivering ^ 

the contract, such as preparing contracts, 
. ' ordering materials, preparing matdHals for*** - 
♦ an 'event, making arri^ttgements for antevent. " 

^ , c.' Number and cost of intfernal meetings foi;^ 

7, planning, resfblving Issues, staff maintenance 

and development. 

y . ' * " ♦ • 

d. Investigate the possibility of a TAU focused ' 
. / 'on trainJ.ng~po8sibly Lab-^wlde~wlth the ^ 

capadity to provide a wide-3?4oge of training 
f servipes... _ 
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2. * Produce a plan for making judgments about ppteSKr. 

clienjt3, to include;' * ' 4 ^ 

' ' , ' * • 

a\ Develojp a formula for responding to request^*, 
* . Determine whether or not to re^igpnd to all • 
request^. . • \ * 

*. b.- Determination of criteria for judgment about 
the "hot-ness" or *"cold-ness"^ of^a potential 
' client. . ' * . 

, c. A way to determine how^the value ("hot" or Vcold^*) 
of a^^tential cliapt^ cTianges over tim^. ' ^ , , 

'd. A way to determine how useful judgments about 
clien-ts are< ^nd in what. ways they affect the 
.priorities. of the TAU. , , j 
• ♦ . • ' . ^ ^ \ , 

3. Find ways arid n^ns^to continually recon^eptualize and 
^ ; revitalize ITCP producf s* and tlieir "tl^e The packages 

are static. " I ^ ' ' t 

4. Look >at, the TAU f unctioning^eparately from all other 
FRDWU activities in order "^to be more precise in • 
determining what it really costs to .operate a TAU. 

5. Determine how much royalty comes to NWREL as the result 
- of sale of materials; compute the effect on the cost • 

effectiveness of t^he TAU. 

6. Do cost accounting f\inctionally^ I.e., posts of^AU 
functions of marketing, servicing and maintaining 

J t^e staff. \, . * ^ . 

7. Prepare an historical reconstruction of contracts 
signed during the period of study to assist in the- • 
identification of all' the costs incurred in 
securing a contract. 

. ^ 

8.. . Become ers explicit 'as possible* about strategies.' 
Write them dowa.;' Make use of the ^Iman Model for 
Intervention Theory to assist 'in^'t his. process.' ^ 
(See PETCrlll instructional system). 



Field Orientatior^^ of the TAU ^ - * ' 

Ot)erate from the perspective that schocfls ha^re 
problems they want solved, inst.ead of persuading 
. schools to install ITCP syst ems « • 

2, Concentrate on helping sohools- adapt ITCP curriculum 
to their own needs. / 



fiecojne field oriented instead of NiE oriented. 



Consider whether an organizational developnent 
mode of needs assessment, which leave's the client 
in control, or a marketing of 'services mode, which , 
leaves the TAU in control, is the best way to approach 
the, fl.eld. 



Marketing Ideas fi^ the TAU ^ ^ / 

X. Find w^s to enlarge the TAU. 

^\ 

a. Provide a laifge, diversified list of offerings. 

b. Invite people who ire technical assisters to' 
join NWREL fgr^'a year ajid pay^a 'fee. In return 
NWREL (the TAU) could, aot as broker 'to secure 

^ jobs. * 

2. Utilize the expertise of WREi-related people to 
' -develop^ currlc«^lum and promote their availability; ^ 

3- Help Schools find funding — help the^' ^to write ^ 
proposals ta secure funding. I* 

• • <. " * 

4. Offer to help school people wtite X^tle I* ijropo^ais; 

- Xn retutn for which the proposals would include ^ 
staff development training provided^by the TAU. 

5. Concentrate on "selling" yourself a*n4 what you can* 
do instead' of being bound by the approach of sellitig • 
ITCP packages and materials. '* 

6. In 1977 concentrate on presentations and /f^ou- * 
, strations of the uses of ITCP produe^fc^. ^ ^ . ^ . • 



In 1977 cultivate past users of ITCP product^. 



60 



July 22, 1976 - (In attendance: 2 evaluators, 2 professionals from TAU) 
, ^ ' • • 

* The main agenda items were to clarify support staff assignments in 

the TAU to facilitate the evaluators in locatl-ff^ needed information and 

^ • • ' .1? 

to set dates for- future meetings. * *• \^ 

*" *^ ^^'1 .1 - >" - I 

* if 

Dates for future meetings: ' • * 

• August 16, Sept^^ber 2, October 4, October, 29v ^ 
In addition the evaluators will inter^^ew the TAU ^taff inforiially 
as the occasion presents itself, 

August 17, 1976 - ^iji attendance: 2 evaluators, 2 ptof essionals from TAU) 

The main agenda for this meeting was 'to inquire into staff reaction 

to the use of the Activity Report Form <ARF). 

i 1» ' Js filling in the ARF a useful activity? 

' - Useful for capturing highlights of a meiBting; especially 

in follow-up meetings. Th^ecord make% it 4)08sible to 
, ^ continue\on and avoid unfae<^sary repetition 

- Provides a way ta reflect on lhat the cotttacj: wa« all, 
, °^ • about as well as pr^iding a source for refVlfew 

- Useful aa a reminder . ' ^ , , 

- Provides a coamunication iink in the TAU 

- Most ARF are face-to-fac^ activities — phone calls are 
usually recorded on the Contact Record Formd 

- An effort is made to record every activity 'because they 
are so useful . 

« r Form can be improved on by adding kind of contact, by 
adding reactions to the contact - 

' ' ' I 

- It -is hard to remember to fil^ in -the AR^ 



^ 2. Hov do you feel a^out filling In Activity RecordVJorms ? 

- Good feelings 

- Good feelings, although when In the f^^eld It^ls hard 
^to keep up^ . It 16 sometimes difficult to fl^l In the 
ARF at the time, so It gets doiie later. It Is hard 
to remember details until retui:n to the office 

- Positive feeling hai resulted In a decision .to cpntlhue 
tlj;Ls kind of record keeping * 

The TAU st^ff identified the following items as additional worlf 

to \>e rfecordfed in the ARF^ ^ - . ^ 

Preparing materials for workshops 

- 'P^-eparing promotlpnal materials • 

- Recording phone calls • ^''"^^ 

- Recprdln^ workshops 

- Recording meetings^-e. g. , planning for presentations 

- Writing letters r . ^ 

- Negotiating 

- Contracting ^ * * 

The TAU stiff identified the folloidng as additional questions to 
be answered: ' ' \ 

- Vhat problems have you found in writing ARF^s? 

- What TAU problems are y<^ becoming aware of? ' 

- What hunches do you have about what it takes to run a TAUl 



September 10, 197& (In attendance: 2 ^valuators, -2 professionals 

from TAU) 



Agenda items for this meeting:^ 

1. Review Activity Record Forms 



s 



■ o Interview staff about cqfltent 
o Reviej/ objectives of the TAU 

tiwn 
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2. Review evaluat»n questions 



1- 




3. Make plans for Review Panel 
r-.,..^. Make a proposal for October 4 w^Btir 
The following proposal for "bur October^4 meeting was agreed to: 

' o Conduct an intensive interview of tti^ ARF's whic.h . 
relate .directly to the TAU - 

* • • 
o Inquire into what makes an activity, e.g., a teacher* 
education activity, become a TAU activity 

The following comments were made in- respbnse to questions from the 

evaluators: , . * 

. 1. There are -op problems with the evaluation proc^edures 

that are not the human ones of remembering to take the 
" forms and the time la^jse between the activity and - 
filling in the fortn.- Interviewing about the activity, 
helps. ^ . 

* ' ' » 

2. ' ,Co r res pond ence has slacked off. There is a close 

relationship between correspondence and 'afield wprk. 
There'has been little *time Ifor field contacts. because 
, of the press- of other work. ^ 

3. ^ TAU contacts are/ hy preference, made. Iarg4ly by 

telephone and by face-to-face contacts. The 
effectiveness and usefulne^g of ^ correspondence * - 
has not been tested. 

■ . . : ■ . ■ V 

4. At this time there is lio 'going out to seek business. 

' • The T^\] is responding to inquiries cojaing as a 

* result of NWREL mailings, .workshop Aperience with 
staff and follow-up of leads secured itf other (pot 
» f * J14i7) ^contacts. 

5. Face-to-face cofitacts are critical and have come 
abput because e^ff was already ^ut in the field on 
other FRDWU business. 

6. A TAU budget of about ^24,000 was broken out in April. 
• Special TAJJ contracts will result in a little more ^ 

Xhan $24, boo income. 'The TAU is paying fqr itself. 

J. Feasibility quystibns are the only ones being asked. 

^ Would like t(/ be abl6 to answer questions like: 

•* 

- What kind of technical assistance is appropriate 
for the- change desired by a particular client? 

,> . ' I 

\ ' ,< ^ 

- Technical assistance tb dp ,what? ' 

- Why this par^cular assi^taoce for this particular 
\' client? ^ \ . " . , ' 

i 

■ tJ4 ' 
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8. Thig^ process (of being-»-interviewed) is a good one because 
^ it raises the'^level of awareness of the importance of > 
documenting. The probing going on makes ^us thinK .of a 
number of things that had hot occurred to us~or, makes \, 
^ • us think about thing^^^jif f erently. , 

Questions and Tasks for TAU Support Staff: Jl 

1. Get information ^or fe>hese meeting^s, e.g, a spot check / 

of records. ^ 

~~ — « 

--^zT^o^ many hours, number of phone calls, trips taken,' 
yto'^land a contract? . h- 

Ji. Under$cpre key words (in ARF). that describe the pature 
. of the activitjr, e.g.^ "negotiate, " "tentative ag'r^^ent." 

Feedback about this meeting t ' • 

- Helpful, relaxed, useful 

- Wish this kind of activity cpuld have started a long time 
ago, am sensing some Wcitement ^ ^ 



October 4, ^1976 - (In atteridance: 2 evaluators, 2 professionals from TAV) 

Of the 42 activities reported as of October 4, 1976, TAU professional 

N > ^>\^ ^ 

Staff members ma^e the following 'statements : 

1. Five of the activities were done in connection with a contract 

2. One has since resulte4,,in a contract* 

3. Six are likely to result in contract's at some future time 
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Appendix F: 

ANALYSIS OF ACTIVITY RECORD FORj!S 
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Analysis of Activity Record Forms 



i< c 



Number of .Entries' - 42 ' ^ 

Number of entries, each rep6rting staff 

Staff A - 1> 
' ^ Staff B - 29 

f . 



0 > 

* if . 


1 o L<ci X ii umo 6 £^ 


Staf'f Reporting 
'a B , 


Phone 


■ \ 16 /. 


' 5 
• 8 


' 11 

• 

16 . 


plan 


1''4 


5 " 
■ 9 • 


14 
. 5 


Off l^e/ Workshop 
. Qthers 


f . • 


V. 

1 


6 . . i 
6, 


Time Reported 


, Total Number 


staff Reporting 
A B • 


' ^ '- 

10-30 minutes 


11 


■ . 3 


f 

8 


30-60 minutes 


. 4 


2 . 


2 • 


60-120 minutes 

« 


. 8 


1 - 


7 


2 hours 


2 


V i 


1 


1 day . ^ 


9 

\ 

. ^ 2 


5 


4 


2 days 


0 


* 2 



6/ 
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o 





X 








\ 




1 


• . SUMMARY 
ACTIVITY 


OF TAU 
REPORTS 










/• 


1 

f^er son 




- 


— 1^ 


I 


Kind of Activity. 




Tiae (including pr< 


eparacion 


and event) 


u 
« 

JO 

i- 

2 


^hone 


— 1 — 

Psbe 


to 


SHare 1 
Info, 1 


Diagnose 

Promote 

Eaplore 

tit ark * 


Office 
WorE 

Workshop 
VIork 


pother 

' ' Ji 


10-30 
Mioutes 
Ik ^ c 


30-60 
Minutes 


60-120 
Minutes 


2 Houja 


1 Day 


2 Days 


— — ^ — 

A 






X 


• 






)iSCU<8S jH 

^1 










( 

\ — ^ 




B 


2 






V 
A 






^lessage 

' r t ■ 














B 


3 




» 






w • snup 










• 




X and 1\ hrs 


B 


4 


X 




X 








f 

■ 














5 




X 






W. shop 


t 










, JL 


X and 2 hrs. 


B 


^ 6 


X 


✓ 


* X 






>• 














B 


7 , 


' X 










_!_£ 














} B 


8 




X 








Inputf on 
t Instru* ' 






X \ 








A 


9 


X. 






— 








X and 

Jll fiiinv 






J — ^ 


' — ^ 


B 


10 




x^ 












\ 




X 




i i 






* 




X 


X - 










^ 
















X 




— ♦ 

X 










X and' 
15 mln. 


^ 








13 


X 












1 * 


* " 1 


X 










lA 






# 




Prdfiare 




r — * 




♦ 




b day^ 




B 


1 s 

i. J 


V — 

X 




.X 










X aitd 

30 min: 




J 






A' 


16 




*- " . 

X 


X 


^ X 






— 






i 


^ day 


• r > 


A i 


17 






— 


X 



















A 


18 




X 






J 


Discuss 
Instru. 






? ' 






• 


B 
B 


1^ 




X 




<3 . . 


X 


5 






X 




' f ' ' 




• 



u:5 



ill) 

J 



\ 




1 ' 



> 



# Person 
Reporting 


u 
«» 

JO 

§ 


KtQd of Activity 


; ^r^^ • ^ 

Tl»e (Inc^ludlng preparation and event) ^ 


Phone 


r— 

Face- to 
P^ce 


Share 
Info. 


Diagnose 
ProMote 

Explore 
Plan 


tJii ice 
Work 
Workshop 
Work 


T)ther, 


10-30 
Himites . 


30f60 
Minutes 


6(^120 
Hlnutea 


2 Hours 


1 Day 


2 Days 


B 


20 




X 


X 


X 




• 






' X 









B 


21 




X 


X 


* 

• 


p 








X 








A 


22 




X 




X 



















B 


23 


' X 


X 










— " 












B V 


0/. 


X 










Conf irm 


^ X 


— y- 










A • 


25 


X 


^ 


X 








X 






-1 






B 


26 




■ ■ i 

X 




nsta 

(father ln{ 












X and 
30- mln. 







B 


27 




X 




X 










X 


" — ^ 








28 






• 




W. Shop 








— % 








B W 


29 




X 


• * 


- 


Prepare 
Budget 




* • y 

• X 






• 




* 


A 






X 




X 








• 






X 




■A- -.. ■■ ■ > 

A ^ 


Ji 


• 


X 




>« 




V 


— 






t ' ' 


Y , V . 




A 








• 


X 




. t 




* 




— 


X 




B 


33 


X' 










Dlsci/ss 
Dates 


' , • X 












B 


34 




X 


* 




slYOp 


-f — ■ 














B 


35 


X ^ 






4 




Response 
to Bid . . 


X 












A 


36' 


X 




r . 


X 


















• * • 
A 


37 




r 




k 




4 


X 






V 






" . iP — 


38 


X 












^ X 













Person 
Reportlng^ 


. Number 


Kind of Activity 


Tl»e (Including preparation and event} ^ 


Phone 


Face- to 
Pace 


Share 
Info, 


Diagnose 
ProBQte 

Explore 
Plan 


Office 
Work 

Workshop 
Work 


Other 


10-.3P. 
Minutes 


30-60, 
Minutes 


60-120 
Minutea 


2 Hbur« 


1 Day 


. 2 Days 


B 


35 




X • 










X 










—t- 


B 


40 




X 


X 










X 










'*B - 


41 






X 


X 






X- 




m 










42 


X 


^ * X 


X 








X 








— * 




~ ^ • ^ ' • ' ^ ^ ^ • / • , 




4f • 



7 
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, Sununai^of Data From, Contact Record Form^ 



Number of entries - 78 



TAU contacts - 6 ' . 

^ State Department of Education 1 

School Districts 3 

Other Educational Agencies 2 



How good 'a prospect ? ^ 

^ Niimber 

Active (R) 



Potential* (G) 
Dropout (Y) 

Agencies of Contacts Made 



3 
32 
43 



Perc ent 
4% 

41 

55 ^ 



How Good a 



Uylver sit ies /colj^eg^s / 


Number 
19 


B ere ent 
24% 


R 
1 


G' Y 
2^ 5 


Other educational # 
agencies ^ ^ 




• 24 


0 


.8 li 


,School D^lstrict 


13- 


17 


. 2 • 


5 6 


Other agencies 


j ' - 
10 


13 ' - 


0 


. 5 . 5 


State Department of 
Education 


8 


10 


1 


'2 '5 


School building 
No agency listed 


7 

-2 


• • 9 

3 ■ ^ 


0 

0 

4 


1 1 



Positions/Roles of Contactors 



Executive directors of programs/ 
proj ect^ /services 

Teachers/professors 



Number 

21 
11 



Percent 

27% 
■ 14 



Positions/Roles of Contactors (continued) 

Numbfer 

Coordinators of programs/projects/ * 7 
"services » 

Assistant superintendent/admini- * 5 
strative assistant ^ — r • 



Percent 



Consultants ,* 

Deans 

Educational specialises ' ^ 

Principals 

Cbunselors 

Superifitendent . 

Others 

No lijsting ' . 



3 
3 
3 
3 
2 
1 
8 
11 



^4 
4 
4 
A- 
3 
1 
10 
14 



Sex of Contactors 
Female 28% 
Male 72%. 
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Agencies,' Roles, Location of Contractors 

School" District 1. Asst* Supt. , Vancouver, 

/ * 2. Coor<i. Adm. Tmg. Maryland 

3. Coord. Adm. Tmg. Maryland 

SliOE 4. Director of staff California 

^ - I -Dev-r Network - 

Statewide . 

University 5. Director of - ^ Florid'a 

• * ' Curriculum and 
Instruction 

Coord, of Trng. Hawaii 
and Consultation 

Director , . Florida 

Administrator Washington 



B. Or" 

I 



Early Education Program 6. 

Jeacher Education Center 7. 

Educational Service 8, 
• District a 



National Sohool 
Executives 



9.' Associate Director Virginia 



76 



Oregon 
Florida 
Michigan 
Pennsylvania 
; Washington 
California - 
Alaska * 
British Columbia 
Idaho 

« 

Montana 
New Jersey 
Texas 
Australia 
Colorado 
England 
Georgia 
Hawaii^ 
^ Iowa-* 

^Kentucky ' 

Maryland (Virginia) 
, Minnesota 

Missouri 

South Dakota 

Virginia/(Maryland) 



} 



12 

4 
3 
3 
3 
2 
2 
2 
2 
2 
2 



Washing t^, D 
West Virginia 

J 

Wisconsin 



ERLC- 



00 



ERIC 




SPECIAL, CONTR^ SUMMARY'^AS OF l(jfl9/76 



I 



CLIENT 



Early Educat?4on Frogram 



National School Exertitives 



Sta^e De^>attnient of Educat^n 



^ucatiqnal Servltt^ lAst. 



\ — r 

Teacmjig Cai^ter - Florida 



Canadian Schoo^ District 



Cbunty Public SchOblS' 



' "M^ * — 

Rylyfal Wor;kshop* » ' 




Far wjgst Laboratory.* 



CONTRACT 



InCerper3onal Conmunlcacloas 
Workshop 

— " "• - * ^J/' 

InterpeApnal Influence ^ 
Workshop ^ * • . • 



; iit^^^ersonal Influence 
WorksfilJp^ 



Research Utilizing Problem 
Jolvlng Workshop 



j|ETC-I.\ Skills Trainining 
W6rkshop 



factXitating Inquiry in t% 
Classroom * ^ 



Interpersonal Influence 
Workshop- / 
» > 



Xjitefpersonal Influence, 
W.orl;i3hop 



Travel and per diem to partici- 
pate in Inter-Lab) Consortium 



— ^' 

Ko shared, cost c'on||pac.ts 
* 



DATES 



-3/15/76 



6/15/76 



4/26/76 



"i" 4/3Q/76 



5/1/76 



6/1/76 



Vi/76 



9/1/76 



6/1/76 



9/l/7j 



9/15/76 



7— T" 

12/31/76 



11/9/76 



•11/12/76 



8/9/76 



■^/13/76 



10/^ 



11/31/76 



aAoi 



lUNT 



$ l,867.pO 1^;^ ' 

— -^-^ 



*?,0OO.OO 



3,524.004 , 



2,598.00 



^^7.W 



• 3,800.00 



3|,452.pO • 



2,42^.00 



;2,ooo.oo 



Although ^ese special contratftri are .a]^o inclu4ed in other component^ of xhijmm 
they are JJ|ptpd here **bficause 'they cbntrlb»ti§d infermation dnd 'contacts for the ^ 



: tStal ; 21,326.00 
T^U Budget . 24,862.00 
**'los8 ' .^,534. Of) 
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1 



^^Mfttarthvveit Regional Educational Laboratory 



Submitted ''by 



'Date 



BUCK3ET SUMMARf 
Contract 



Division Director 



Component field Relationg-^ and Dissemination 

work Ifiit ■ 

Technical Assistance ' 



Contract Officer Approval 

CM^. 



Activity . 
Milestone 
Event- _ 



Planned start date 
Planned end'date . 



/DESCRIPTION 



'R 



Pptt^Nfl. COSTS 
SALARIES 
, PERSONNEL BENEFITS* 
CONSULTANT CLAIMS 
OTHER PERSONNa , , 

TRAVEL '& TRANSPORTATiA 
STAFF TRAVEL ~ » 
CONSULTANTS TRAVa 
OTHtR TRAVEL 

i 

POSTAGE & SHIPPING 

R£NT>COMMUN. & UTILITIES 
«PACIi.lTy_REN|ifliL ' 

EQUIPMENT RENTAL '•. 
'^k^P»ONl & TELEGRAPH 
, UTILITIES 

*>RINTINg'8i CXiPLICATION 
' PRINTING 
i DUPLICATION 

other services^ 
. data processing 
subcontracts / 
conference expanses 
Other services' 

^UPPLtES & MATERIALS 
OFFICE SUPPLIES 
• -PRIfTTED MATERIALS v 
DTHER SUPPLIES 



Fiscal year 



•SI Ml DATE 



END DATE 



5110 



5120 



5130 



5310 
"5355 



" 1976 ■ 



ll/30/,?6 



10,726 



1,909 
9W 



BUDGET BY, TIME PER^ 



54J0 



5510 



5520 



5530 



5540 



5610. 



5620- 



5710 



TOTAL DIRECT COSTS 
E0UIPMENT PURCHASES 
-INDIRE9T COSTS* s 20.5*i. 



I 

fEEg> 



TOTlJ. COSTS 
% ^ 



TOTAL COSTS AND FEE 



5720 



' 5730 



5740 



5810 , 



5820 



5830 



6,035 



267 



854 



A73 



2,272 



575 



83 



134 



13A 



5Q0^ 



•5910 



6200 



$24,862 > 



' ^'^ '*»<'«5ct cost7iir •« applied to direct cottt ochJ. th«n «qu<pmeni purchase 

BO ' BS - 06:' 74 # * ' 



TOTAL 
BUDGET 



I* if 





I 



Schedule A 



^LARlES AND PERSONNEL BENEFITS 



Contract 

Activity Technical Asyl^tance Work Unl^ 

StaQ« ^ ' . W 

Account ' ' 



Position 
Title 


Class. 
• • 


Name 


Ra 

Salary 


Benefits 


Period/ 


B(j 


Kiget 






'Program 

Associate 


D'125.59 
A* 


22.50 


37-84 


Salary 

i,752 ^» 


, Benefits 
















851 






Program 

Associate" 


97. 7Q 


17.71 


37.84 


3,700 


670 






















Sut>pi6rt 
Staff 


— — \ 

17. ftp 


5.10 


39.50 


1,496 




" • ^ — 
























Suppcnrt 
Staff 


19.70 


4.74\ 


39.50 ' 


778 


187 






• 




















V— 














f 


k t ^ { 




















— ^ 














- 




-v-* 






\ ■ . •■ 


^ 
















r 


































^ — ■ — 








i 








* 






^ i . 


— ^ • — 










« 
















-7- ■ — * L 






















Total Staff Davs , 


♦ 




— -il 


Provision for salary /ncre8S0 during th« contract term 
'total SALARIFS ' 










to, 726 


> : 

1,909 


fdtAL Actual PERSONNEL BE^l^«Ts . ••(5?oo) 



I 



'•D» Daily: A = Annual 
••rias^rSalary Range Niimber ' 
BO-BS, 7y5>\^ 



9. 
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I' 
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